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SUBSTTTUE SPECIFICATION 



MULTI- CHANNEL, MULTI -SERVICE DEBUG ON A PIPELINED 

CPU ARCHITECTURE 



FIELD OF THE INVENTION 

The present invention relates to interactive debugging and 
more specifically to interactive debugging in a multi -channel , 
mult i -service environment on a pipelined CPU architecture 
without hardware interlocking. 




10 BACKGROUND OF THE INVENTION 

Traditionally, Digital Signal Processors (DSPs) have been 
used to run single channels, such as, for example, a single DSO 
or time division multiplexed (TDM) slot, that handle single 
services, such as modem, vocoder, or packet processing. 

15 Multiple services or multiple channels require multiple DSPs, 
each running its own small executive program (small kernel) and 
application. The executive programs reserve some area in memory 
for application code. When applications need to be switched, 
these executive programs overlay this memory with the new 

20 application. 

Channels may take one of the following forms: one channel 
carried on a physical wire or wireless medium between systems 
(also referred to as a circuit) ; time division multiplexed (TDM) 
channels in which signals from' several sources such as 

25 telephones and computers are merged into a single stream of data 
and separated by a time interval; and frequency division 
multiplexed (FDM) channels in which signals from many sources 
are transmitted over a single cable by modulating each signal on 
a carrier at different frequencies. 

30 Recent advances in processing capacity now allow a single 

chip to run multiple channels. With this increase in capacity 
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has come a desire to run different services simultaneously and 
to switch between services. 

A current method to implement multiple services or multiple 
channels involves writing all control, overlay, and task- 
5 switching code for each service or channel. This requirement 
causes additional engineering overhead for development and 
debugging of the applications. In addition, not all services 
may fit into the memory available to the DSP, and the services 
must be swapped in from the host system. This swapping- - 

10 overlaying- -adds significant complexity to the implementation of 
the DSP services. The extra development activity consumes DSP 
application development time. 

The fact that DSPs have a single thread of control creates 
problems to developing and debugging in the multi -channel , 

15 multi-service environment. Typically, debugging an application 
on a single chip stops all other applications and channels 
running on the chip. If the chip is running, real-time 
diagnostics on a channel or service cannot be obtained without 
interfering with the operation of the other channels and 

20 services. In addition, a debugging system typically needs to 
have direct access to the chip being diagnosed. That is, a 
conventional debugging system uses a special development board 
or a physical debug interface (such as Joint Test Access Group 
(JTAG) interface) to provide debugging access. This makes 

25 debugging in a production environment an inflexible and 
cumbersome process. 

Debugging optimized code developed on pipelined 
architectures without hardware interlocking is rather difficult 
as the pipelines typically have bypass paths that allow 

30 instructions to use values before they have flowed through the 
pipeline. Debuggers rarely have access to these bypass paths 
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making it difficult for a debugger to save and restore the 
pipeline. This adds complexity to the debugging process. 
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SUMMARY OF THE INVENTION 

A method and system for debugging an executing service on a 
pipelined CPU architecture are described. In one embodiment, a 
breakpoint within an executing service is set and a minimum 
state of the executing service is saved. In addition, a program 
counter of the executing service is altered. The program 
counter is restored and the state of the executing service is 
restored. 




BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example, and 
not by way of limitation in the figures of the accompanying 
drawings in which like reference numerals refer to similar 
5 elements. 

Figure 1 is a system architecture of one embodiment for a 
mult i- channel, multi -service system; 

Figure 2 is a block diagram of one embodiment for a 
processing chip of Figure 1; 
10 Figure 3 is a block diagram of one embodiment for multiple 

sockets/services within a processing chip; 

Figure 4 is an exemplary diagram of channel sockets within 
the multi -channel, multi-service system of Figure 1; 

Figure 5a is a block diagram of one embodiment for an 
15 interactive debugging system; 

Figure 5b is a block diagram of one embodiment for an 
interactive debugging system operating over a network; 

Figure 6 is a block diagram of another embodiment for a 
multi -channel, multi -service system; 
20 Figures 7-9 are exemplary optimized code fragments; 

Figure 10 is a block diagram of one embodiment for a 
minimum buffer basic functional unit state of the system of 
Figure 1 ; 

Figure 11 is a flow diagram of one embodiment for debugging 
25 optimized code; 

Figure 12 is a flow diagram of one embodiment for debugging 
optimized code using safe points; and 

Figure 13 is a flow diagram of one embodiment for 
processing breakpoints in a multi -channel , multi-service 
30 environment. 
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DETAILED DESCRIPTION 

A method and system for debugging an executing service on a 
pipelined CPU architecture without hardware interlocks are 
described. In one embodiment, a breakpoint within an executing 
5 service is set and a minimum state of the executing service is 
saved. In addition, a program counter of the executing service 
is altered. The program counter is restored and the state of 
the executing service is restored. 

In the following detailed description of the present 

10 invention, numerous specific details are set forth in order to 
provide a thorough understanding of the present invention. 
However, it will be apparent to one skilled in the art that the 
present invention may be practiced without these specific 
details. In some instances, well-known structures and devices 

15 are shown in block diagram form, rather than in detail, in order 
to avoid obscuring the present invention. 

Some portions of the detailed descriptions that follow are 
presented in terms of algorithms and symbolic representations of 
operations on data bits within a computer memory. These 

20 algorithmic descriptions and representations are the means used 
by those skilled in the data processing arts to most effectively 
convey the substance of their work to others skilled in the art. 
An algorithm is here, and generally, conceived to be a self- 
consistent sequence of steps leading to a desired result. The 

25 steps are those requiring physical manipulations of physical 
quantities. Usually, though not necessarily, these quantities 
take the form of electrical or magnetic signals capable of being 
stored, transferred, combined, compared, and otherwise 
manipulated. It has proven convenient at times, principally for 

30 reasons of common usage, to refer to these signals as bits, 
values, elements, symbols, characters, terms, numbers, or the 
like. 
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It should be borne in mind, however, that all of these and 
similar terms are to be associated with the appropriate physical 
quantities and are merely convenient labels applied to these 
quantities. Unless specifically stated otherwise as apparent 
5 from the following discussion, it is appreciated that throughout 
the description, discussions utilizing terms such as 
"processing" or "computing" or "calculating" or "determining" or 
"displaying" or the like, refer to the action and processes of a 
computer system, or similar electronic computing device, that 

10 manipulates and transforms data represented as physical 
(electronic) quantities within the computer system's registers 
and memories into other data similarly represented as physical 
quantities within the computer system memories or registers or 
other such information storage, transmission or display devices. 

15 The present invention also relates to an apparatus for 

performing the operations herein. This apparatus may be 
specially constructed for the required purposes, or it. may 
comprise a general purpose computer selectively activated or 
reconfigured by a computer program stored in the computer. Such 

20 a computer program may be stored in a computer readable storage 
medium, such as, but is not limited to, any type of disk 
including floppy disks, optical disks, CD-ROMs, and magnetic- 
optical disks, read-only memories (ROMs) , random access memories 
(RAMs) , EPROMs, EEPROMs, magnetic or optical cards, or any type 

25 of media suitable for storing electronic instructions, and each 
coupled to a computer system bus. 

The algorithms and displays presented herein are not 
inherently related to any particular computer or other 
apparatus. Various general purpose systems may be used with 

30 programs in accordance with the teachings herein, or it may 
prove convenient to construct more specialized apparatus to 
perform the required method steps. The required structure for a 
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variety of these systems will appear from the description below. 
In addition, the present invention is not described with 
reference to any particular programming language. It will be 
appreciated that a variety of programming languages may be used 
5 to implement the teachings of the invention as described herein. 

Figure 1 is a system architecture of one embodiment for a 
multi- channel, multi-service system 100. Referring to Figure 1, 
system element 102 is connected via system bus 104 and bridge 
106 to a plurality of processing chips 108, 110, 112, 114. In 

10 addition, bridge 106 is connected to buffer memory 116. System 
element may be another bridge 106 configuration or other 
suitable component. Bridge 106 is connected via bus 118 to the 
processing chips 108-114. In one embodiment, processing chips 
108-114 are connected via bus 120 to time division multiplexing 

15 (TDM) interface 122. In alternate embodiments, chips 108-114 
may be connected to a digital signal 0 (DSO) interface or other 
applicable interface. In one embodiment, TDM interface 122 is 
connected to a number of modules and ports installed on the TDM 
bus 124. In addition, TDM interface 122 may optionally be 

20 connected to TDM signaling interface 126. 

TDM is a base -band technology in which individual channels 
of data or voice are interleaved into a single stream of bits 
(or framed bits) on a communications channel. Each input 
channel receives an interleave time segment in order that all 

25 channels equally share the medium that is used for transmission. 
If a channel has nothing to send, the slot is still dedicated to 
the channel and remains empty. 

In one embodiment, an operating system running within 
multi -channel , multi-service system 100 supports 

30 telecommunication and data communication applications. These 
applications involve running multiple channels of protocol 
stacks built from multiple services. Multi -channel , multi- 
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service system 100 enables the dynamic configuration of services 
within the embedded telecommunication and data communication 
environment. In addition, the operating system automatically 
defines the allocation of resources for the channels within 
5 system 100 . 

Figure 2 is a block diagram of one embodiment for a 
processing chip 108, Each processing chip 108 contains clusters 
202 and main processor 204. Each cluster 202 contains a cluster 
processor 208 and a number of processing engines (PEs) 210. 

10 Main processor 204 is configured to perform all control code and 
operations including receiving control messages from host 102 
and allocating channels to the various clusters 202. 

Processing chip 108 also includes a shared static random 
access memory (shared SRAM) 206. Shared SRAM 206 may be 

15 accessed directly by all the cluster processors 202 and main 
processor 2 04. An instruction store contained within the PEs 
210 can also access shared SRAM 206. Shared SRAM 206 is used 
for storing operating system and application code as well as 
hosting the data for code running on main processor 204. 

20 Each cluster 202 contains cluster SRAM 212. Cluster SRAM 

212 is responsible for maintaining channel data running on each 
individual cluster 202. Cluster SRAM 212 includes I/O buffers 
and programming stacks. The operating system of system 100 uses 
the hardware to enforce memory protection to prevent a channel 

25 from inadvertently corrupting another channel's data or code. 

External dynamic random access memory (DRAM) 214 may be 
used for application data too large to fit on the on-chip 
cluster SRAM 212 or shared SRAM 2 06 and may be used as a swap 
area for application code. 

30 Each processing chip 108 includes two line side ports 216 

and two bus ports 218. These ports are used for packet side 
data and control transport. In addition, host port 220 is used 
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to communicate with the host 102 and is accessible only from 
main processor 204 and serial boot port 222 that is used to send 
the boot stream to the chip. 

Figure 3 is a block diagram of another embodiment for a 
5 portion of a multi -channel , multi-service system 100. Referring 
to Figure 3, service 302 is a self contained set of instructions 
that has data input/output, control, and a defined interface. 
Service 3 02 performs defined processing upon a certain amount 
and a certain format of data. In addition, service 302 emits a 

10 certain amount and a certain format of data. In an alternate 
embodiment, service 3 02 may process data in a bidirectional 
manner. Service stack 304 is a linked set of services 302 that 
provide a larger processing unit. Service stack 304 is a 
unique, ordered collection of services 302, such as, for 

15 example, echo cancellation services, tone detection services, 
and voice conferencing services. The services 302 within the 
service stack 304 are processed in-order. 

Socket 306 is a virtual construct that provides a set of 
services 3 02 in the form of a service stack 3 04. The operating 

20 system processes services 302 that are encapsulated in socket 
3 06 including connecting the line and/or packet data flow. 
Processing within socket 306 is data driven. That is, services 
302 are invoked by sockets 306 only after the required data has 
arrived at socket 306. In one embodiment, applications may 

25 build protocol stacks by installing a service stack 3 04 into a 
socket 306. Services 302, service stacks 304, and sockets 306 
are allocated and de-allocated as required by system 100. 

Figure 4 is an exemplary diagram of channel sockets (CSs) 
430 (422, 424, 426) within system 100. CSs 430 are specialized 

30 sockets 306 that direct the flow of information through the 
system 100 between two or more devices or end points 402, 404, 
406, 408. End points may be, for example, physical devices. CS 

-10- 



41163/GDL/B600 



430 is a socket 306 that accepts a service stack 304 and 
processes channel data. CS 43 0 connects any line side slot or 
bus channel on one end of CS 430 to any other line side slot or 
bus channel on the opposite end of CS 430. CS 430 is defined by 
5 external, physical interface points and provides the ability to 
process the service stack 304. Information may flow from a 
physical end point 402 via connection 418 to CS 424, The 
information is processed by services 302 within CS 424 and is 
transferred via connection 420 to end point 406. The operating 

10 system may dynamically change the flow of information through 
different CSs 43 0 depending upon the needs of the end points 
402-408. For example, data may be initially set to flow from 
end point 404 via connection 410 through CS 422 and via 
connection 412 to end point 408. However, if service stack 304 

15 within CS 422 is incompatible with the data, CS 422 notifies the 
operating system to break the flow and redirect the information. 
The operating system then redirects the flow to an existing CS 
430 with the proper service stack 304 or creates a new CS 430. 
Referring to Figure 4, the operating system may redirect the 

20 flow from end point 404 to end point 408 through connection 414, 
CS 426, and connection 416. In addition, the operating system 
may replace the service stack in CS 422 with another stack 
compatible with the data. 

A CS 43 0 is defined by the external, physical interface end 

25 points 402, 404, 406, and 408 and the data flowing through the 
CS 430. Each end point 402-408 may be different physical 
devices or the same physical interface or device. CS 422 
services may perform a conversion of data. The CS 43 0 mechanism 
allows a service stack 304 to be built into the information flow 

30 in which services 302 may direct or process the data as it flows 
through the system. For example, if a first service outputs a 
4 0 byte data frame and a second service uses an 80 byte frame. 
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in one embodiment, the second service waits until the first 
service outputs enough data in order for the second service to 
process the data. In an alternate embodiment, the first service 
delays sending data to the second service until it accumulates 
5 enough data. Services 302 are independent modules and are 
standalone plug- ins. Thus, in one embodiment, services 3 02 may 
be dynamically downloaded into shared SRAM 206 in real-time to 
build CSs 43 0 as required by the data. 

Applications may be written without regard for particular 

10 input/output channels or physical interfaces. The operating 
system is in charge of dynamically allocating and deallocating 
sockets and connecting input/output components. Thus, the CS 
430 mechanism provides single channel programming with multiple 
channel execution. In addition, an application may be written 

15 to provide flow of information between end points 402-408 
independent of the type of the operating system and independent 
of the type of data being processed. CS 430 are independent of 
both the operating system and the hardware configuration. The 
mechanism also relieves applications of the management of 

20 channels and places the management into the operating system, 
thus producing channel independent applications. In addition, 
the CS 43 0 mechanism allows the applications and services 3 02 to 
be platform independent. In one embodiment, the CS 430 
mechanism is used in debugging of applications and services. 

25 Since services may be loaded dynamically, the user may choose 
not to have the debugger in the system if there is no need for 
debugging operations. 

Figure 5a is a block diagram of one embodiment for an 
interactive debugging system. Referring to Figure 5a, debugging 

30 system 500 includes debug core 520, graphical user interface 
(GUI) 510, and abstract machine interface (AMI) 53 0. Debug core 
520 is coupled to GUI 510 via a text-based bi-directional 
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interface 505. GUI 510 provides an application developer with a 
simple and convenient way of debugging an application or a 
service. The tools provided by GUI 510 may include, for 
example, top-level menus, context menus, windows, dialog boxes, 
5 and setting of user preferences. Text-based interface 505 
provides two-way communication between debug core 52 0 and GUI 
510. In one embodiment, GUI 510 may receive a command from the 
application developer and send it to debug core 52 0 using text- 
based interface 505. Debug core 520, in turn, may send data to 

10 GUI 510 using text-based interface 505. GUI 510 may then 
display this data to the application developer in various ways. 
For example, debug core 52 0 may pass information about currently 
running sockets and services to GUI 510. GUI may then display 
this information, allow the application developer to select a 

15 socket or service for debugging, and transfer data identifying 
the selected socket or service back to debug core 520. 

Debug core 520 is coupled to AMI 530 via text-based bi- 
directional interface 525. AMI 530 directly communicates with 
chip 550 or simulator 540. Chip 550 represents processing chips 

20 108-114. Simulator 540 may be used to perform diagnostics of an 
application or a service in a simulated environment. Simulator 
540 allows loading and running an application as if it were 
running on the chip itself. All the features and capabilities 
inherent in chip 550 are available through simulator 540. 

25 In one embodiment, AMI 53 0 provides an abstract view of 

multi- channel, multi- service system 10 0 at the hardware and 
operating system level. AMI 530 may work with a single target 
chip or simulator at a time and may view the target chip or 
simulator as a single entity. AMI 530 allows debug core 520 to 

30 provide an isolated debugging environment for each socket or 
service. For example, debug core 520 may maintain a separate 
context (e.g., breakpoints, watchpoints, and variable displays) 
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for each socket or service. In one embodiment, debug core 520 
uses AMI 530 to provide an application developer with the 
ability to control all possible debugging and diagnostic 
activity on a target socket or service. 
5 Text-based interface 525 enables a two-way communication 

between debug core 520 and AMI 530. The use of text-based 
interface 525 simplifies the development process by designing 
debug core 520 and AMI 530 as independent modules. In addition, 
text -based interface 52 5 allows running debug core 52 0 and AMI 

10 530 as stand alone applications. Text-based interface 525 may 
also improve the quality assurance (QA) process by providing a 
QA user with the ability to enter the command and get the 
response back in an automated environment. 

In one embodiment, debugging system 500 may operate in 

15 various modes. For example, a simulator direct mode (Simulator 
Direct) allows debug core 520 to communicate with simulator 540 
using AMI 530. This mode may provide significant visibility 
into the PEs 210 and the state of the system 108, but may not be 
aware of sockets and other high-level operating system 

20 constructs. Simulator Direct provides full control over the 
simulator. Hence, debug core 52 0 may obtain all performance 
analysis results that are supported by the simulator. In one 
embodiment, AMI 530 may analyze the run-time state of system 108 
to determine information about sockets and services directly 

25 from the data structures of the operating system. 

Debugging system 500 may also operate in an in-circuit 
emulator mode (ICE) . ICE allows debug core 52 0 to communicate 
with chip 550 through AMI 530 using an access interface of chip 
550 such as, for example, the Joint Test Access Group (JTAG) 

30 interface. ICE supports debugging of the operating system by 
controlling the cluster processors 208. ICE does not provide 
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access to PEs 210 and is not capable of controlling or accessing 
sockets . 

Another exemplary mode is an application debug mode 
(Application Debug) . Application Debug may work with either 
5 simulator 540 or chip 550. Application Debug relies on the 
assistance of the operating system to provide access to system 
resources (e.g., PEs 210 and cluster processors 208). 
Application Debug is capable of controlling and accessing 
sockets and allows debug core 52 0 to maintain information about 

10 running sockets and services. Debug core 520 may communicate 
the information to GUI 510. GUI 510 may then present this 
information to the application developer for selecting a target 
construct on which to perform debugging operations. It will be 
recognized by one skilled in the art that the modes described 

15 above are merely exemplary and that a wide variety of modes 
other than those discussed above may be used by debugging system 
500 without loss of generality. 

Figure 5b is a block diagram of one embodiment for an 
interactive debugging system operating over a network. 

20 Referring to Figure 5b, host computer system 560 includes a 
debugger which communicates with computer system 570 over a 
network connection 565. In one embodiment, host 560 contains 
debug core 520 and GUI 510. Network connection 565 may 

include, for example, a local area network and a wide area 

25 network. Computer system 570 includes chips 576 which 

communicate over bus 572 via interface 574 with host 560. In 
one embodiment, bus 572 is a peripheral component interconnect 
(PCI) bus with host 560. In alternate embodiments, bus 572 may 
be an industry standard architecture (ISA) bus, a VESA local 

30 bus, or a micro channel architecture (MCA) bus. Interface 574 
enables communication between chips 576 and bus 572. In one 
embodiment, the debugger may operate in ICE debugging mode. In 
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this embodiment, interface 574 communicates commands from host 
560 to cluster processors of chips 576 and then communicates the 
resulting data from chips 576 to host 560, 

Alternatively, the debugger may operate in Application 
5 Debug mode. In Application Debug mode, a debugging request from 
host 560 is sent over network 565 to computer system 570. 
Interface 574 communicates the request directly to chip 576. 
The operating system on chip 576 interprets the request into 
commands (e.g., set breakpoints or watchpoints, stop the 

10 execution, read memory, get status, or display a variable) , 
performs these commands, and generates the appropriate response. 
The response is then transferred back to host 560 over network 
connection 565. Network connection 565 may be packet-based 
(e.g. TCP/IP), cell-based (e.g. ATM) or serial based (e.g. 

15 SpiceBus or Utopia) . In one embodiment, in a multi -channel , 
multi-service environment, the operating system on chip 576 may 
transfer information about running services to host 560 over 
network connection 565 and allow the debugger on host 560 to 
operate on an individual service or on a set of services. 

20 Figure 6 is a block diagram of another embodiment for a 

multi -channel , multi-service debugging system 600. Referring to 
Figure 6, system 600 may have a number of processing elements 
(or constructs) (610) running within a cluster 202. In one 
embodiment, executing service 610 may run a real time 

25 application and debugger 660 may run a control task or an 
operating system task. A number of executing services 610 may 
be running within basic functional unit (PE) 670. PE 670 
includes save stub 662 and restore stub 664. Save stub 662 is 
an executable program written to save the minimum state of 

30 construct 610. Restore stub 664 restores the minimum state from 
memory 620. The minimum PE state (MPES) is a minimum amount of 
executing service 610 state registers which are saved and 
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restored in order to halt service 610 execution and restart it 
again without altering the functional behavior of service 610. 
Debug 660 runs on a processor other than the PE 670. Debugger 
660 interacts with save stub 662 and restore stub 664 to read 
5 and/or modify service 610 state information and control service 
610 execution. 

In one embodiment, executing service 610 has independent 
local memory 620 and debugger 660 has independent local memory 
640. In one embodiment, executing service 610 and debugger 660 

10 may have shared memory 630, in which separate portions of memory 
630 may be assigned to executing service 610 and debugger^ 660, 
respectively. Within system 600, executing service 610 has a 
state 650 which contains the information for running service 
610. In one embodiment, debugger 660 may have the capability of 

15 accessing data related to the operation of service 610. -In 
addition, save stub 662 and restore stub 664 access, save, and 
restore certain information from state 650 during a breakpoint 
operation. Debugger 660 may communicate with host 102, or host 
560 over a network, and perform the commands received from host 

20 102 or 560 in order to effectuate a breakpoint or watchpoint . 

In one embodiment, debugger 660 may access the data related 
to the operation of executing service 610 without affecting the 
real time environment of executing service 610. For example, 
debugger 660 may be able to look at ("snoop" on) local memory 

25 62 0, state 650, and the portion of shared memory 63 0 which is 
assigned to executing service 610. In addition, debug 660 may 
directly access the following state information of construct 610 
without altering the state of construct 610: program counter, 
next program counter, PC delay slot enable signal, page numbers, 

30 tags, valid bit, fetch bit, and LRU information, memory 
contents, breakpoint and/or watchpoint registers and enable 
bits, construct 610 status, configuration contents, address unit 
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configuration contents that may not be read by instructions, and 
two performance registers and their control values. 

In one embodiment, the debugging process may directly 
intercede with the real time environment of executing service 
5 610. Debugger 660 may, for example, modify state 650 to set a 
breakpoint register or a watchpoint register, request a 
notification when target construct 610 hits a breakpoint, and 
stop the operation- of executing service 610. Subsequently, 
debugger 660 may restart the operation of executing service 6l0 

10 upon receiving a command from host 102 or 560. 

Figures 7-9 are exemplary optimized code fragments executed 
by services 3 06 within system 100. Referring to Figure 7, 
instructions 1, 2, and 3 are load from main memory instructions. 
Within system 100, these load from memory instructions require 

15 multiple pipeline cycles to complete from the time they are 
initially executed until the data is available in the register. 
Thus, line 1 is executed and requires a certain amount of 
pipeline cycles in order for the value loaded into register 3 to 
be available. In one embodiment, main memory loads require 

20 three delay slots (pipeline cycles) between the load instruction 
and an instruction that uses the returned value. Thus, the load 
of register 3 in line 1 is not available at line 4 for the add 
of registers 3 and 4 into register 6. Line 4 uses the old 
values of registers 3 and 4 (those values that existed as a 

25 result of operations executed prior to line 1) to add into 
register. In one embodiment, an instruction at line 5 could use 
the value returned from memory as a result of the load 
instruction at line 1. The pipeline may be designed such that 
the instruction at line 5 receives the "new" value of register 3 

30 via a bypass path before register 3 is actually written in the 
register file. A debugger may not have visibility of the 
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bypass, thus, making it difficult to ascertain the value of 
register 3 at line 5. 

Referring to Figure 8, a typical code fragment of optimized 
code is shown in which values in memory pointed to by register 1 
5 are loaded into register 3 in lines 1-4. In lines 5-8, the 
resulting register 3 values are stored back into the memory 
locations pointed to by register 1, In this code fragment, the 
value loaded in line 1 is available for the store operation at 
line 5; the load operation of line 2 is available for the store 

10 operation of line 6; the load operation of line 3 is available 
for the store operation of line 7; and the load operation of 
line 4 is available for the store operation of line 8. As noted 
above, these "new" values of register 3 may be available via 
bypass paths buried within the CPU micro-architecture, thus, 

15 making an external debugger difficult as it can not determine 
the value of register 3 until it is written into the "debugger 
visible" register file. 

Figure 9 is another exemplary optimized code fragment. In 
the multi -channel , mult i -service system 100, if a breakpoint is 

20 inserted at line 5, the debugger 660 needs to store the old 
values of registers 5 and 6 that existed prior to the executions 
of lines 3 and 4. After a breakpoint is initiated, PE 670 
flushes or clears all information in the pipeline. The old 
values in registers in transition need to be saved in order to 

25 recreate the pipeline after control is returned to PE 670. 
These old values are needed to reinitialize the pipeline in 
order for the service executing the code of Figure 9 to properly 
add the correct values of registers 5 and 6 into register 7. 
The breakpoint mechanism will be described below. Registers 5 

30 and 6 are termed unstable registers and line 5 is termed an 
unstable register point. An unstable register point is a point 
in a code fragment where service 610 instruction is using a 
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register which is in the process of changing, but the new 
register value will not be available until one or more cycles 
later. Debugger 660 reads the scalar registers (registers 5 and 
6) and creates a pipeline restore array in the MPES prior to 
5 calling save stub 662. When debugger 660 is ready to 
reinitialize service 610 after debug operations have been 
executed; debugger 660 swaps the old values of registers with 
the new values stored in the MPES. After execution of restore 
stub 664, the pipeline restore array is filled with the new 

10 values of unstable registers and then a series of stack "pop" 
operations are executed to refill the pipeline. After execution 
of the four "pop" operations, service 610 continues normal 
operation. The pipeline restore array is a 16 byte array in the 
MPES. In one embodiment, the pipeline restore array contains 

15 the three potentially unstable scalar registers followed by the 
value of the stack pointer at the time of the breakpoint. 

Figure 10 is a block diagram of one embodiment for a 
minimum buffer PE state (MPES) 1000. MPES 1000 is the minimum 
amount of information saved and restored by debugger 660 to 

20 allow service 610 to continue execution following a breakpoint 
without affecting the functional behavior of the code executing 
on service 610. Breakpoints are implemented in a manner that 
they do not negatively affect program behavior except for real- 
time timing issues. 

25 MPES 1000 is stored in a cluster memory location accessible 

to the service and the OS. Referring to Figure 10, MPES 1000 
includes scalar registers 1002, predicate registers 1004, vector 
registers 1006, least significant 32 bits of accumulator 0 
(1008) , most significant eight bits of accumulator 0 (1010) , 

30 least significant 32 bits of accumulator 1 (1012) , most 
significant eight bits of accumulator 1 (1014) , least 
significant 32 bits of multiplier output register 1016, most 
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significant one bit of multiplier output register 1018, loop 
count value 102 0, vector count value 1022, exponent register 
1024, configuration registers 1026, vector unit VREG A and VREG 
B registers 1028, VAO through VA3 states 1030, MAU state 1032, 
5 and old values of pipeline registers 1034 (potentially unstable 
scalar registers) . 

Save stub 662 is responsible for saving vector registers 
1006, the least and most significant bits of accumulator 0 and 
accumulator 1 (1008-1014) , the least significant and most 

10 significant bits of multiplier output register (1016, .1018), 
loop count value 1020, vector count value 1022, exponent 
register 1024, vector unit VREG A and VREG B registers 1028, 
VA0-VA3 state 1030, and MAU state 1032. Debugger 660 is 
responsible for saving scalar registers 1002, predicate 

15 registers 1004, configuration registers 1026, and pipeline 
registers 1034. Debugger 660 is also responsible for restoring 
pipeline registers 1034. Restore stub 664 restores MPES 1000, 
but leaves the stack pointer pointing to the pipeline registers 
array. Debugger 660 single steps (executes) four instructions 

20 which "pop" the pipeline registers off the stack in four cycles. 
After these four instructions have been executed, target 610 
stack pointer will point to the desired location. If debugger 
660 is not performing a debugger 660 invoke function call, the 
stack pointer will be equal to the value that it contained at 

25 the time of the breakpoint. 

Service 610 cannot save the old state of the scalar 
register 1002 and the predicate register 1004 in a single cycle. 
Thus, debugger 660 must save either (or both) the predicate 
registers 1004 or the scalar registers 1002. In one embodiment, 

30 predicate registers 1004 and scalar registers 1002 are saved by 
debugger 660. In one embodiment, debugger 660 saves the 
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configuration registers 1026 as target 610 has no instruction 
capable of saving its own configuration registers 1026. 

Debugger 660 saves pipeline registers 1034 as only debugger 
660 knows what set of three potentially unstable registers must 
5 be saved for a given breakpoint. Target 610 does not know which 
three potentially unstable registers are in transition. Save 
stub 662, in one embodiment, may be written to handle all 
possible permutations of these three unstable register loads. 

Figure 11 is a flow diagram of one embodiment for debugging 

10 optimized code. Initially at processing block 1102 debugger 660 
sets a breakpoint within executing service 670. Debugger 660 
locates an instruction to insert the breakpoint and sets the 
breakpoint at the location. In one embodiment, debugger 660 
starts the PE and waits for the PE to halt at the breakpoint 

15 location. After the PE reaches a breakpoint, debugger 660 waits 
for the PE memory fetches and configuration loads to complete. 
Debugger 660 then removes the breakpoint from executing service 
610. 

At processing block 1104, debugger 660 saves the state of 
20 PE 670. Debugger 660 saves PE ' s 670 scalar registers, predicate 
registers, and configuration registers. In one embodiment, 
debugger 660 determines if. any of the scalar registers are in 
transition. When a breakpoint occurs, there may be several 
scalar register write-backs in the pipeline waiting to be 
25 executed or to finish execution. Debugger 660 cannot access the 
pipeline but must flush the pipeline, reading the scalar 
registers after each cycle. In one embodiment, there may be up 
to three unstable scalar registers in the pipeline at any time. 
In one embodiment, there is a three cycle load delay for scalar 
30 registers. However, in this embodiment, an additional two cycle 
latency is also required in order to complete the flush of the 
pipeline. In one embodiment, debugger 660 single steps two PE 
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670 instructions before it may safely read the "old value" of 
the unstable registers. Debugger 660 saves the values contained 
within the unstable registers and performs a series of no-op 
instructions to flush the pipeline. Thus, in this embodiment, a 
5 total of five instructions are required to flush the pipeline 
and store the register values. 

Debugger 660 may record any predicate changes following 
each first no-op. Debugger 660 records up to three scalar 
register changes following the third, fourth and fifth no-ops. 

10 If the breakpoint occurred on an instruction that uses old 

values of scalar registers (uses values of registers as they 
existed before the values were changed with instructions still 
in the pipeline) , debugger 660 executes a sequence of 
instructions which will record the old values of these 

15 registers. In one embodiment, two registers may be in 

transition at any point. Debugger 660 places the correct values 
of these scalar registers into the MPES before calling the 
restore step below. In one embodiment, debugger 660 executes 
four instructions to record the values of these scalar registers 

20 which includes two no-op instructions. In one embodiment, only 
two scalar registers that depend upon old values may be within 
the pipeline at any time. After the four instructions are 
executed, the original values of the two scalar registers are 
saved in debugger 660 registers. Debugger 660 uses these values 

25 to restore the pipeline after debug operations are completed. 

At processing block 1106, debugger 660 alters the program 
counter of the PE to point to save stub 6 62. Debugger waits for 
PE 670 to execute the breakpoint instruction. After PE 670 
executes the breakpoint instruction, debugger 660 stores the 

30 saved configuration registers 1026 into MPES stack frame 1000. 
In one embodiment, debugger 660 factors the 33 -bit memory 
register field in the MPES frame 1000 into a pair of 16-bit 
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numbers and stores them into multiplier output register field 
1016 and 1018. Debugger 660 determines the correct value of all 
16 scalar registers and stores their state into scalar registers 
1002. These values are what is expected by the very first 
5 service instruction to be executed after control returns to 
service 610, In most cases, this will be the instruction on 
which the breakpoint was originally set. 

Registers to be loaded into the pipeline before returning 
to the service are stored in the MPES 1060. The values stored 

10 are the "new values" of the unstable registers which were 
retrieved from the MPES and saved in the previous processing 
block. The three registers must be stored in the correct order 
to recreate the pipeline properly. Debugger 660 stores - the 
value of the stack pointer at the time of the breakpoint within 

15 MPES. This value will allow the initial stack pointer to be 
restored properly after refilling the pipeline. 

At processing block 1108, debugger 660 optionally executes 
debug commands and optionally changes one or more items in ' the 
MPES. Alternatively, MPES 1000 information may be transferred 

20 to host 560 for display. Items changed may be, for example, 
scalar registers, vector registers, or the like. The debug 
commands are issued from debugger 660. 

At processing block 1110, debugger alters the program 
counter of PE 670 to point to the restore stub of debugger 660. 

25 Debugger 660 begins PE 670 execution and waits for the PE to 
execute the breakpoint instruction. 

At processing block 1112, the debugger restores state 650 
to the original state. Debugger 660 processes restore stub 664 
to restore the state of PE 670. Restore stub 664 restores 

30 everything in the MPES except for the pipeline registers. 

If the breakpoint originally occurred in an instruction 
that does not make use of old values of scalar registers, the 
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host debugger must single step through instructions to restore 
values of the three possibly unstable scalar registers. After 
these registers have been restored, the original pipeline at the 
time of the breakpoint for these possibly unstable registers 
5 will have been recreated and a stack pointer at the time of the 
breakpoint will have been restored. 

If the breakpoint occurred on an instruction that does make 
use of old values of scalar registers, debugger 660 restores 
these scalar registers, stores the original values of the 

10 remaining scalar registers into the MPES pipeline registers and 
loads the pipeline from the stored registers. 

After the pipeline has been restored, debugger 660 alters 
the PE's program counter to point to the original breakpoint 
location and starts PE 670 execution. 

15 Figure 12 is a flow diagram of one embodiment for debugging 

optimized code using safe points. Initially a processing block 
1202, debugger 660 attempts to set a breakpoint. If the 
debugger attempts to set the breakpoint at an unsafe location, 
in one embodiment, the debugger does not allow the breakpoint to 

20 be set at the unsafe location, but rather attempts to find the 
nearest safe location (prior to the desired location) to set the 
breakpoint. Referring to Figure 9, if a breakpoint is attempted 
to be set at line 5, debugger 660 will search back within the 
code to a point in which registers are not in transition within 

25 the pipeline. In the example of Figure 9, this safe point would 
be prior to line 3 as line 5 uses the "old values" of registers 
5 and 6 in the addition. 

At processing block 1204, debugger 660 locates the previous 
safe point within the instructions and sets the breakpoint at 

30 that location. Unsafe breakpoint locations are points in the 
instruction set where the host debugger must disallow 
breakpoints. After debugger 660 sets the breakpoint at a safe 
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location, debugger 660 starts PE 670 and waits for PE 670 to 
execute the breakpoint instruction. 

At processing block 12 06, the debugger saves the state of 
the PE to a simulator. In one embodiment, the simulator is on a 
5 remote host. In one embodiment, the debugger saves PE registers 
and other state information in order to restore the PE to its 
state after debugging has occurred. Values saved are similar to 
those described in reference to Figure 11 above. 

At processing block 1208, debugger 660 simulates the 

10 instructions from the safe point found at processing block 1204 
to the next safe point past the breakpoint in the instruction 
code. In addition, the debugger may insert commands to debug 
the code as described above. Once debugger 660 has executed the 
code in the simulation, debugger 660 returns control to PE 670. 

15 At processing block 1210, the debugger stores the simulated 

state to state 650. Operations are similar to those described 
in reference to Figure 11. After the debugger stores state 650, 
debugger 660 starts PE 670 execution at the breakpoint 
instruction . 

20 Figure 13 is a flow diagram of one embodiment for 

processing breakpoints in a multi -channel , multi-service 
environment. Initially at processing block 1302, PE 670 fetches 
a page of instruction code into memory 62 0 for execution. In a 
multi -channel , multi-service environment, multiple PEs may be 

25 executing the same set of instruction code for a given service 
306. Within system 100, only one program memory exists for a 
given service 306. Each PE fetches a memory page into its own 
cache for processing. Thus, any breakpoint inserted into the 
instruction code will be executed by all PEs. In order to 

30 execute breakpoints for only a given PE, each PE performs a 
checksum for a fetched memory page as it is being fetched. 
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At processing block 1304, after PE 670 checks the page of 
memory for its checksum, it is determined whether the checksum 
has passed or failed. If the checksum test has passed, PE 670 
continues execution of the page of memory and eventually returns 
5 to processing block 1302 for fetching a next page of memory. 
However, if the checksum test fails, execution continues at 
processing block 1306. 

At processing block 13 06, it is determined whether PE 670 
is to accept or reject the checksum error. Host debugger 660 

10 may send commands to individual PEs to ignore checksum errors. 
If PE 670 has received a command to ignore checksum errors, 
processing continues at processing block 1302. However, if PE 
670 has received a command to reject checksum errors, processing 
continues at processing 1308, 

15 At processing block 13 08, debugger 660 copies the page of 

memory from the PE cache into a separate cache area. The 
separate cache area may be within debugger 660 or within PE 670. 

At processing block 1310, debugger 660 inserts the 
breakpoint into the saved memory page. Debugger 660 alters the 

20 program counter of PE 670 to point to the saved memory page and 
initiates execution of the PE within the saved memory at 
processing block 1312. 

At processing block 1314, debugger 660 begins the 
processing of the saved memory page. The processing of the 

25 saved memory is as in steps 1104 through 1112 of Figure 11. 
After PE 670 executes the altered page of memory, PE 670 will 
load a new page of memory at processing block 13 02 and continue 
processing . 



30 environment, debugger 660 will process the breakpoint of all 



Within the processing of multi -channel , multi-service 



services running on a single processor. 



In an alternate 
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embodiment, only one service will be running on a PE at any 
particular time. 

Several variations in the implementation of the method for 
interactive debugging have been described. The specific 

5 arrangements and methods described here are illustrative of the 
principles of this invention. Numerous modifications in form 
and detail may be made by those skilled in the art without 
departing from the true spirit and scope of the invention. 
Although this invention has been shown in relation to a 
10 particular embodiment, it should not be considered so limited. 
Rather it is limited only by the appended claims. 
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